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Real-time CORBA Becomes a Reality 

Contact: 

Chris Vander Rhodes 
Object Management Group 
Phone: +1-508-820 4300 ext. 115 
Email: chrisvr@omg.org 



Framingham, MA, USA— July 20, 1999— The Object Management Group (OMG) just completed a vote to adopt the Real- 
time CORBA 1.0 specification. Traditionally, one of CORBA's strengths has been that it offers developers the ability to work 
at a high level of abstraction. This allows programmers to focus on the application rather than the minutiae of network 
programming, leaving detailed decisions on priority and task scheduling to the CORBA implementation. However, in some 
critical applications, the programmer needs to be able to override these defaults to exert more control over these lower level 
details. 

Real-time CORBA offers a response to this need by allowing specialists to concentrate on the details and performance issues 
of working in both homogeneous and heterogeneous distributed environments. This approach builds on capabilities provided 
by existing real-time operating systems; it does not try to duplicate or replace those capabilities. It establishes a fundamental 
set of broadly applicable real-time CORBA capabilities, based on mature technologies, and is not only usable on its own 
merits, but also provides a stable basis for extension. 

While this need was initially recognized in specialized environments, such as Air Traffic Control, the real-time extensions to 
CORBA's ability are very important to other industries that also require control over Quality of Service and end-to-end 
predictability. This is a common trend in the development of OMG specifications. While specifications are often developed 
to meet the needs of a very particular group, the OMG's open process encourages input and adoption of those specifications 
to meet wider industry needs. 

Professor Doug Schmidt of Washington University, a recognized expert in the area of real-time systems, said, "There has 
been a surge in demand for standards-based real-time middleware in a many domains including telecom, aerospace, process 
control, and financial services. The OMG's Real-time CORBA specification is the first middleware standard to meet this 
demand head on." 

One of the most promising markets for the application of Real-time CORBA is in the telecommunications industry. Lucent 
Technologies plans to develop a product using Real-time CORBA, which is expected to be available in beta in September 
1999. Besides Lucent, other submitters on the Real-time 1.0 specification include Alcatel Alsthom Recherche, Hewlett- 
Packard, Highlander Communications, IONA, Borland Corporation, Lockheed Martin, Nortel, Object-Oriented Concepts, 
Objective Interface Systems, Sun Microsystems and Tri-Pacific Software. 

### 

CORBA®, The Information Brokerage®, CORBA Academy®, and the Object Management Group logo® are registered 
trademarks of the Object Management Group. OMG™, Object Management Group™, the CORBA Logo™, ORB™, Object 
Request Broker™, the CORBA Academy logo™ HOP™, XMI™, MOF™, OMG Interface Definition Language™, IDL™, 
CORBAservices™, CORBAfacilities™, CORBAmed™, CORBAnet™, UML®, the UML Cube Logo™, and Unified 
Modeling Language™ are trademarks of the Object Management Group. All other products or company names mentioned 
are used for identification purposes only, and may be trademarks of their respective owners. 
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Patterns and Performance of Real-time 
Object Request Brokers 

Douglas C. Schmidt 

Associate Professor Elec. & Comp. Eng. Dept. 

schmidt@uci.edu University of California, Irvine 

www.ece.uci.edu/~schmidt/ (949) 824-1901 

Sponsors 
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OCI, Oresis, OTI, QNX, Raytheon, SAIC, Siemens SCR, Siemens MED, Siemens ZT, 
Sprint, Telcordia, USENIX 
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Motivation: the QoS-enabled Software Crisis 

• Symptoms 

- Communication hardware gets 
smaller, faster, cheaper 

- Communication software gets larger, 
slower, more expensive 

• Culprits 

- Inherent and accidental complexity 

• Solution Approach 

- Standards-based COTS Hardware & 
Software 
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Problem: the COTS Hardware & Software Crisis 
• Context 




HARDWARE & 
SOFTWARE 



- Adopting COTS hardware & 
software is increasingly essential for 
real-time mission-critical systems 

• Problems 

- Inherent and accidental complexity 

- Integration woes 

• Solution Approach 

- Standards-based adaptive COTS 
middleware 
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Context: Levels of Abstraction in 
Internetworking and Middleware 



RTP 



TELNET 



DNS FTP HTTP 



UDP 



TCP 



CORBA 
APPLICATIONS 



CORBA SERVICES 



CORBA 



ETHERNET I ATM I FDDI ■ WIN NT ■ LINUX I LYNXOS 



FIBRE CHANNEL 
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Problem: Lack of QoS-enabled Middleware 



>f--BI 



APPLICATIONS 



COMMON 


fWMI 




MIDDLEWARE 




, SERVICES 







DISTRIBUTION 
MIDDLEWARE 




• Many applications require QoS 
guarantees 

- e.g., avionics, telecom, WWW, 
medical, high-energy physics 

• Building these applications 
manually is hard and inefficient 

• Existing middleware doesn't 
support QoS effectively 

- e.g., CORBA, DCOM, DCE, Java 

• Solutions must be integrated 
horizontally & vertically 
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Candidate Solution: CORBA 



INTERFACE 
REPOSITORY 



1DL 

COMPILER 



IMPLEMENTATION 
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^ ^ STANDARD INTERFACE ^\ ( ) STANDARD LANGUAGE MAPPING 
ORB-SPECIFIC INTERFACE C~^) STANDARD PROTOCOL 

www.cs.wustl.edu/~schmidt/corba.html 



Goals of CORBA 

• Simplify distribution 
by automating 

- Object location & 
activation 

- Parameter 
marshaling 

- Demultiplexing 

- Error handling 

Provide foundation 
for higher-level 
services 
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Overview of the Real-time CORBA Specification 

end-to- end priority Features 




Q STUBS J 



EXPLICIT 
BINDING 



1 . Portable priorities 

2. End-to-end priority 



STANDARD C SKE1J!TOfs ) 
SYNCHRONIZERS 

OBJECT ADAPTER 




THREAD 
POOLS 



GIOP 



.'ORB CORE 



PROTOCOL 



OS KERNEL 



i PROPERTIES 4 



propagation 

3. Protocol properties 

4. Thread pools 

■ 5. Explicit binding 
6. Standard synchronizers 



( OS t/O SUBSYSTEM J 
NETWORK ADAFTERSJ 



^os i/o subsystem J www.cs.wusti.edu/-schmidt/ 
oorc.ps.gz 
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ORB ENPSYSTEM A 




Portable Priorities 
Features 

32767 



ORB ENDSYSTEM B 



Designed to support 
heterogeneous real-time 
platforms 

• CORBA priorities range from 
0 -> 32767 

• Users can map CORBA 
priorities to native OS 
priorities 

• No silver bullet, but rather an 
"enabling technique" 
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Configurable Protocol Properties 



interface Protocol Properties { } ; 



Features 



typedef struct { 

IOP: : Prof ileld protocol_type; 
ProtocolProperties 

orb_protocol_properties; 
ProtocolProperties 

transport_protocol_properties ; 
} Protocol ; 

typedef sequence <Protocol> ProtocolList ; Options 



• Select and configure 
communication 
protocols 

- e.g., TCP socket 



interface TCPProtocolProperties 
: ProtocolProperties 

{ 

attribute long aend_buf fer_size,- 
attribute long recv_buf f er_size; 
attribute boolean keep_alive; 
attribute boolean dont_route; 
attribute boolean no_delay,- 



Supports ORB protocol 
and transport protocol 
configuration 

Ordering in 
ProtocolList 
indicates preferences 
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Our Approach: The ACE ORB (TAO) 



CLIENT I 0 "" 




www.cs.wustl.edu/~schmidtrrAO.html 



TAO Overview -> 



• An open-source, 
standards-based, 
real-time, 
high-performance 
CORBAORB 

• Runs on 
POSIX/UNIX, 
Win32, & RTOS 
platforms 

- e.g., Vx Works, 
Chorus, LynxOS 

• Leverages ACE 
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The ADAPTIVE Communication Environment (ACE) 

ACE Overview -> 



• A concurrent 
00 networking 
framework 

• Available in 
C++ and Java 

• Ported to 
POSIX, Win32, 
and RTOSs 

Related work -> 

• x-Kernel 

• SysV 
STREAMS 




^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 



www.cs.wustl.edu/~schmidt/ACE.html 
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ACE and TAO Statistics 



• Over 50 person-years of effort 



• Ported to UNIX, Win32, MVS, and 
RTOS platforms 

• Large user community 

- ~schmidt/ACE-users.html 
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• Currently used by dozens of 
companies 

- Bellcore, BBN, Boeing, 
Ericsson, Hughes, Kodak, 
Lockheed, Lucent, 
Motorola, Nokia, Nortel, 
Raytheon, SAIC, Siemens, 
etc. 

• Supported commercially 

- ACE www.riverace.com 

- TAO-* 
www.theaceorb.com 
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- ACE > 200,000 LOC 

- TAO > 200,000 LOC 

- TAO IDL compiler > 130,000 
LOC 

- TAO CORBA Object Services > 
150,000 LOC 
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Applying TAO to Avionics Mission Computing 
Domain Challenges 




Air 
\ Frame 



EVENT 
CHAXNfcL 




REPLICATION 
SERVICE 


3lPl.SH (EVENTS) 



2: SEVSOR PROXIES DEMARSHAL DATA 
& PASS TO EVENT CT1A.WEL 



OWECT REQUEST BROKER 




• Deterministic & statistical 
real-time deadlines 

• Periodic & aperiodic processing 

• COTS and open systems 

• Reusable components 

• Support platform upgrades 

www.cs.wustl.edu/^schmidt/TAO- 
boeing.html 



www.cs.wustl.edu/~schmidt/JSAC- 
98.ps.gz 
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Applying TAO to Distributed Interactive Simulations 




www.cs.wustl.edu/~schmidt/ 
Words99.ps.gz 



Domain Challenges 

• High scalability and group 
communication 

• High throughput and low 
latency 

• "Interactive" real-time 

• Multi-platform 

hlasdc.dmso.mil/RTISUP/hla_soft/ 
hla_soft.htm 
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Optimization Challenges for QoS-enabled ORBs 

Key Challenges 

• Alleviate priority inversion 
and non-determinism 

• Reduce demultiplexing 
latency/jitter 

• Ensure protocol flexibility 

• Specify QoS requirements 

• Schedule operations 

• Eliminate (de)marshaling 
overhead 

• Minimize footprint 

UC Irvine G) r G*G 20 




1) CLIENT MARSHALING 

2) dJENT PROTOCOL 

3) NETWORK LATENCY 

4) SER\T3t PROTOCOL 



5) THREAD DISPA TCHISG 

6) REQUEST DEHVXLSG 

7) OPERA TtON DEMWONG 

8) SERVAXT DEMARSHAUSC 
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Problem: Optimizing Complex Software 

^ 4f3^ TrT^>r=^ Common Problems -> 

• Optimizing complex software 
is hard 

• Small "mistakes" can be costly 
Solution Approach (Iterative) -> 

• Pinpoint overhead via 
white-box metrics 
- e.g., Quantify and 

VMEtro 

• Apply patterns and framework 
components 

• Revalidate via white-box and 
black-box metrics 




www.cs.wustl.edu/~schmidt/ 
JSAC-99.ps.gz 
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Solution 1: Patterns and Framework Components 

Definitions 
• Pattern 




www.cs.wustl.edu/~schmidt/ORB- 
patterns.ps.gz 



- A solution to a problem in 
a context 

• Framework 

- A "semi-complete" 
application built with 
components 

• Components 

- Self-contained, "pluggable" 
ADTs 
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Lessons Learned Developing QoS-enabled ORBs 

• Avoid dynamic connection management 

• Minimize dynamic memory management 
and data copying 

• Avoid multiplexing connections for 
different priority threads 

• Avoid complex concurrency models 

• Integrate ORB with OS and I/O 
subsystem and avoid reimplementing 
OS mechanisms 

• Guide ORB design by empirical 
benchmarks and patterns 
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Concluding Remarks 

• Researchers and developers of distributed, real-time applications 
confront many common challenges 

— e.g., service initialization and distribution, error handling, flow control, 
scheduling, event demultiplexing, concurrency control, persistence, fault 
tolerance 

• Successful researchers and developers apply patterns, 
frameworks, and components to resolve these challenges 

• Careful application of patterns can yield efficient, predictable, 
scalable, and flexible middleware 

- i.e., middleware performance is largely an "implementation detail" 

• Next-generation ORBs will be highly QoS-enabled, though many 
research challenges remain 

UC Irvine H) r O*S 25 
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Web URLs for Additional Information 

• These slides: ~schmidt/TA04.ps.gz 

• More information on CORBA: ~schmidt/corba.htmi 

• More info on ACE: ~schmidt/ACE.htmi 

• More info on TAO: ~schmidt/TAO.htmi 

• TAO Event Channel: ~schmidt/jsAc-98.ps.gz 

• TAO static scheduling: ~schmidt/TAo.ps.gz 

• TAO dynamic Scheduling: ~schmidt/dynamic.ps.gz 

• ORB Endsystem Architecture: ~schmidt/Rio.ps.gz 

• Pluggable protocols: ~schmidt/pluggable_protocols.ps.gz 

UC Irvine Q'G'G 26 



High-performance, Real-time ORBs 



Douglas C. Schmidt 



Web URLs for Additional Information (cont'd) 

• Network monitoring, visualization, & control: ~schmidt/NMvc.htmi 

• Performance Measurements: 

- Demuxing latency: ~schmidt/cooTS-99.ps.gz 

- SI I throughput: ~schmidt/SIGCOMM-96.ps.gz 

- DM throughput: ~schmidt/GLOBECOM-96.ps.gz 

- ORB latency & scalability: ~schmidt/ieee.tc-97.ps.gz 

- HOP Optimizations: ~schmidt/JSAC-99.ps.gz 

- Concurrency and connection models: ~schmidt/RT-perf .ps.gz 

- RTOS/ORB benchmarks: 

~ schmidt /RT- OS . ps . gz 
^-schmidt/words-99 .ps .gz 
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High-performance, Real-time ORBs 



Do 



Caveat: Requirements/Limitations of 
CORBA for QoS-enabled Systems 



NETWORK 
OPERATIONS 
CENTER 





(«►►►■) 



HSM 
ARCHIVE 
SERVER 



www.cs.wustl.edu/~schmidt/RT-ORB.ps.gz 

Requirements Limitations 

• Location transparency • Lack of QoS specifications 

• Performance • Lack of QoS enforcement 
transparency • Lack of real-time 

• Predictability programming features 
transparency • Lack of performance 

• Reliability tranparency optimizations 
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High-performance, Real-time ORBs 



Do 



End-to-End Priority Propagation 



(A) SERVER i 

declare: 

MODEL 



ORB 

p ENDSYSTEM 



(2) PRIORITY IS 



ORB 

1^^^^ ENDSYSTEM 



(3) CLIENT'S PRIORITY 

IS NOT PROPAGATED 
BY INVOCATION 



r 



| (1) SERVER 
PRIORITY 
IS PRE- SET 



c: 



(B) CLIENT 

PROPAGATED 
MODEL 



ORB 

ENDSYSTEM 
A 



GLOBAL CORBA PRIORITY = 100 



SERVICE 
CONTEXT 
= 100 


i r 


SERVICE 
CONTEXT 
= 100 


r ORB ^ 



~1 



LYNXOS 
PRIORITY 

= 100 



r 



ENDSYSTEM 
B 



0 



WINNT 
PRIORITY 

= 5 



r 



ORB 

ENDSYSTEM 
C 



SOLARIS 
PRIORITY 

= 135 



r 



El 



Current: :priority(100) Current: :priority(l 00) Current: :priority(l 00) 
to_native(100) => 100 to_native(100) => 5 to_native(100) => 135 

www.cs.wustl.edu/~schmidt/RT-ORB-std- 

new.pdf.gz 

Features 



Client priorities can propagate end-to-end 
Servers can also declare priority 
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High-performance, Real-time ORBs 



Do 



Thread Pools 



THREAD 
POOL 



CHILD 
POA 



Root POA 



THREAD POOL 



Threadpoolld id = 
createthreadpool 

(static_threads, 

max_threads, 

stack_size, 

default_priority); 



SERVER ORB CORE 

I/O 
THREADS 



• Pre-allocate threads and thread attributes 

- Stacksize 

- Static threads 

- Maximum threads 

- Default priority 

• Applicable at both the ORB and POA level 
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High-performance, Real-time ORBs 



Do 



Explicit Binding 

validateconnection (out CORBA::PolicyList 
inconsistent_policies); 



CLIENT 
ORB CORE 



SERVER 
ORB CORE 



P l-5 ^10-20 P 21-100 



I 



^1-5 ^10-20 ^21-10(1 



PRIORITY-BANDED 



PRIVATE CONNECTIONS 



Features 



Enables pre-establish ment of connections 

- Priority-banded connections 

- Private connections 

- Protocol policies 
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High-performance, Real-time ORBs 



Do 



Standard Synchronizers 




Features 



• A portable Mutex API 

— e.g., lock, unlock, try_lock 

• Necessary to ensure consistency between ORB 
and application synchronizers 

• Locality constrained 
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High-performance, Real-time ORBs 



Do 



Applying TAO to Embedded Network 
Element Management and Control 



SIGNALING PROCESSOR NETWORK OPERATIONS CENTER SIGNALING PROCESSOR 



CONNECT REQUEST 

ENDSYSTEM A 




Domain Challenges 

• High-speed (20 Gbps) ATM switches 
w/embedded controllers 

• Low-latency and statistical real-time deadlines 

• COTS infrastructure, standards-based open 
systems, and small footprint 
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High-performance, Real-time ORBs Do 

Solution 2: ORB Optimization 
Principle Patterns 

Definition 

• Optimization principle patterns document 
rules for avoiding common design and 
implementation problems that can degrade the 
efficiency, scalability, and predictability of 
complex systems 

Optimization Principle Patterns Used in TAO 



# 


Optimization Principle Pattern 


1 


Optimize for the common case 


2 


Remove gratuitous waste 


3 


Replace inefficient general-purpose 
functions with efficient special-purpose ones 


4 


Shift computation in time, e.g., precompute 


5 


Store redundant state to speed-up 
expensive operations 


6 


Pass hints between layers and components 


7 


Don't be tied to reference implementations/models 


8 


Use efficient/predictable data structures 
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